788 research outputs found

    Bridging Graph Position Encodings for Transformers with Weighted Graph-Walking Automata

    Full text link
    A current goal in the graph neural network literature is to enable transformers to operate on graph-structured data, given their success on language and vision tasks. Since the transformer's original sinusoidal positional encodings (PEs) are not applicable to graphs, recent work has focused on developing graph PEs, rooted in spectral graph theory or various spatial features of a graph. In this work, we introduce a new graph PE, Graph Automaton PE (GAPE), based on weighted graph-walking automata (a novel extension of graph-walking automata). We compare the performance of GAPE with other PE schemes on both machine translation and graph-structured tasks, and we show that it generalizes several other PEs. An additional contribution of this study is a theoretical and controlled experimental comparison of many recent PEs in graph transformers, independent of the use of edge features.Comment: Camera-ready version, reduced certain claims and minor rewordin

    Laboratory measurements of electrostatic solitary structures generated by electron beam injection

    Full text link
    Electrostatic solitary structures are generated by injection of a suprathermal electron beam parallel to the magnetic field in a laboratory plasma. Electric microprobes with tips smaller than the Debye length (λDe\lambda_{De}) enabled the measurement of positive potential pulses with half-widths 4 to 25λDe\lambda_{De} and velocities 1 to 3 times the background electron thermal speed. Nonlinear wave packets of similar velocities and scales are also observed, indicating that the two descend from the same mode which is consistent with the electrostatic whistler mode and result from an instability likely to be driven by field-aligned currents.Comment: 5 pages, 4 figures http://link.aps.org/doi/10.1103/PhysRevLett.105.11500

    SWIFT: A Low-Power Network-On-Chip Implementing the Token Flow Control Router Architecture With Swing-Reduced Interconnects

    Get PDF
    A 64-bit, 8 × 8 mesh network-on-chip (NoC) is presented that uses both new architectural and circuit design techniques to improve on-chip network energy-efficiency, latency, and throughput. First, we propose token flow control, which enables bypassing of flit buffering in routers, thereby reducing buffer size and their power consumption. We also incorporate reduced-swing signaling in on-chip links and crossbars to minimize datapath interconnect energy. The 64-node NoC is experimentally validated with a 2 × 2 test chip in 90 nm, 1.2 V CMOS that incorporates traffic generators to emulate the traffic of the full network. Compared with a fully synthesized baseline 8 × 8 NoC architecture designed to meet the same peak throughput, the fabricated prototype reduces network latency by 20% under uniform random traffic, when both networks are run at their maximum operating frequencies. When operated at the same frequencies, the SWIFT NoC reduces network power by 38% and 25% at saturation and low loads, respectively

    First direct observation of a nearly ideal graphene band structure

    Get PDF
    Angle-resolved photoemission and X-ray diffraction experiments show that multilayer epitaxial graphene grown on the SiC(000-1) surface is a new form of carbon that is composed of effectively isolated graphene sheets. The unique rotational stacking of these films cause adjacent graphene layers to electronically decouple leading to a set of nearly independent linearly dispersing bands (Dirac cones) at the graphene K-point. Each cone corresponds to an individual macro-scale graphene sheet in a multilayer stack where AB-stacked sheets can be considered as low density faults.Comment: 5 pages, 4 figure

    Phase Correlations in Cosmic Microwave Background Temperature Maps

    Full text link
    We study the statistical properties of spherical harmonic modes of temperature maps of the cosmic microwave background. Unlike other studies, which focus mainly on properties of the amplitudes of these modes, we look instead at their phases. In particular, we present a simple measure of phase correlation that can be diagnostic of departures from the standard assumption that primordial density fluctuations constitute a statistically homogeneous and isotropic Gaussian random field, which should possess phases that are uniformly random on the unit circle. The method we discuss checks for the uniformity of the distribution of phase angles using a non-parametric descriptor based on the use order statistics, which is known as Kuiper's statistic. The particular advantage of the method we present is that, when coupled to the judicious use of Monte Carlo simulations, it can deliver very interesting results from small data samples. In particular, it is useful for studying the properties of spherical harmonics at low l for which there are only small number of independent values of m and which therefore furnish only a small number of phases for analysis. We apply the method to the COBE-DMR and WMAP sky maps, and find departures from uniformity in both. In the case of WMAP, our results probably reflect Galactic contamination or the known variation of signal-to-noise across the sky rather than primordial non-Gaussianity.Comment: 18 pages, 4 figures, accepted for publication in MNRA

    Impact of multimorbidity count on all-cause mortality and glycaemic outcomes in people with type 2 diabetes: a systematic review protocol

    Get PDF
    Introduction: Type 2 diabetes (T2D) is a leading health priority worldwide. Multimorbidity (MM) is a term describing the co-occurrence of two or more chronic diseases or conditions. The majority of people living with T2D have MM. The relationship between MM and mortality and glycaemia in people with T2D is not clear. Methods and analysis: Medline, Embase, Cumulative Index of Nursing and Allied Health Complete, The Cochrane Library, and SCOPUS will be searched with a prespecified search strategy. The searches will be limited to quantitative empirical studies in English with no restriction on publication date. One reviewer will perform title screening and two review authors will independently screen the abstract and full texts using Covidence software, with disagreements adjudicated by a third reviewer. Data will be extracted using a using a Population, Exposure, Comparator and Outcomes framework. Two reviewers will independently extract data and undertake the risk of bias (quality) assessment. Disagreements will be resolved by consensus. A narrative synthesis of the results will be conducted and meta-analysis considered if appropriate. Quality appraisal will be undertaken using the Newcastle-Ottawa quality assessment scale and the quality of the cumulative evidence of the included studies will be assessed using the Grading of Recommendations, Assessment, Development and Evaluation approach. This protocol was prepared in adherence to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols guidelines to ensure the quality of our review. Ethics and dissemination: This review will synthesise the existing evidence about the impact of MM on mortality and glycaemic outcomes in people living with T2D and increase our understanding of this subject and will inform future practice and policy. Findings will be disseminated via conference presentations, social media and peer-reviewed publication

    Model Predictive Control Combined With Genetic Algorithms For A River System

    Full text link
    Flood is one of the natural disasters. It frequently causes costly economic losses and numbers of lives come to harm. Due to these severe injuries, how to perform an effective flood control is always a huge challenge for governments and water authorities. In order to establish successful flood control strategies to prevent or alleviate flood damages, besides implementing operating rules (regulations) established by water authorities for the hydraulic structures, applying real time optimization-based control strategies is a supplementary tool for water managers to make decisions. It is expected that the importance of such real time control strategies will become more important in the future. It is an ideal adaptation strategy in a world that is rapidly changing, for instance due to urbanization and climate trends. Real time control indeed allows making more efficient use of existing storage capacity available in flood control reservoirs. In order to accelerate the large number of iterations concerning the hydraulic computations in optimization procedures, a simplified river conceptual model was developed and connected to a Model Predictive Control (MPC) algorithm. This tool was applied to determine efficient real-time flood control policies for the 12 gated-weirs in the Belgian case study of the river Demer around two main flood control reservoirs. Because the system dynamics are nonlinear (gate openings are considered as inputs in the MPC), the MPC was combined with Genetic Algorithms (GAs) to cope with the nonlinear problems. The MPCGA model searches for better control actions by minimizing the cost function while at the same time avoiding violation of the defined constraints. The optimization results testify that MPCGA is capable of improving of the current regulation strategy that is based on fixed regulation rules and three-point controllers
    • …
    corecore